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The iise of readability principles in the ERIC . 
guidelines for abstracting suggests that abstracts should be more 
readable than source documents. However, information theory suggests 
that the compression of information would result in less readable 
abstracts. Abstracts and their source documents were selected 
randomly from each of four clearinghouses also selected randomly. 
Sample size was determined by a calculation of power. The Flesch RE 
formula was used to calculate readabili/ty scor^. Results of an 
analysis of variance indicated that abstracts were less readable than 
source documents but their meawi grade iievels of 11.7 to 12.7 were 
within the expected reading ability level of users of the ERIC • 
system. (Autlor) 
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Some years ago it was popular to discuss an "explosion of 
knowledge." Dramatic figures were given concerning the rate of 
publications in scientific and technical fields. (Levine, Worboys and 
Taylor, 1973). Some critics have clained that much was replication 
or repetition of older work and that the addition of new materials 
was not great. However, there can be no doubt that the advance 
of scientific and technological knowledge has produced an increase in 
the volume of materials.' The student, as well as the professional 
researcher, is faced with a majo^ problem in identifying papers 
pertinent to his field. Scientific, technical and scholarly 
societies traditionally have approched the problem by providing abstracts 
of publications in their particular fields. Some of these absttact- 
ing services have functioned for nearly a hundred years. Probably, 
the earliest was established by the Abbott Laboratories in 1888. The 
Chemical Abstract Service was started in 1907 and the, Psychological 
Abstracts in 1927 (Kruzas , 19 71) i There are now indexes to abstracting 
services, which in themselves, ftave produced a formidable task for the 
scholar who would want to acquaint himself with a particular topic. 
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Most scholarly societies havcj relied upon volunteers from . 
their membership to write abstracts of journal article*;, monographs , 
and pertinent resources. The general pattern has been for 'the society 
to provide guidelines which encouraged writers to be brief, to avoid 
technical terras , and to make the abstracts readab.le. The purpose of 
making them readable is to assist the person who is not an expert in 
the field in identifying articles which will be of the greatest use. 
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More readable* abstracts also are valuable to the researcher who mast 
process rapidly a .great body of Information to select pertinent 
documents. Abstracts have become such a part of academic 3if<^ that 
few people question their usability. In fact, it is generally 
assumed that they are functioning well. 

The advent of the computer and of programs which could retrieve 
and classify abstracts for the scholar have posed a number of interesting 
problems. Solutions have been found to the library problem of indexing, 
and classifying abstracts^^A barrier still exists between the scholar 
and the literature if abstracts, once they are located, are not precise 
and readable. An interesting conflict exists. One dimension of the 
conflict can be deduced from the field of readability. 

By preparing brief abstracts of a highly readable nature,, the 
size of the audience should be increased. Thus, the information contained * 
in the literature of an academic or scientific field should be made 
more useful to a larger audience. Second, the problem of abstracting 
can be viewed from the position of information theory. The writing 
of short abstracts reduces the redundancy normally found in language; 
it increases the density of information and the rate with which it will 
be transmitted. These' factors should make the abstract materials much less 



useful to tihose not thoroughly trained in the field. 

In surveying several computer b;2scd retrieval services , it 
becomes apparent that while they function well, they have not approached 

their goal,. Most services have experienced low usage for computer 

\ 

based searches even though they can identify relatively large numbers 
of articles in a brief period of time. J?oiae have suggested that the 
reason is the cotnmon aversion in many fields to the uue of the 
computer. Others emphasize the fact that u computer • search normally 
identifies a large number of abstracts. The common excuse is that upon 
receiving a stack of computer printouts the user plans to. look at 
them later — only man^na never comes; the problem of the ability of 

the abstracts to transmit information is obviated.* Perhaps, if they 

\ 

were highly readable, tjiey could be scanned rapidly' and not laid aside.- 
Thus; the readability of abstracts is a beginning point for examining 
the usability of a system. 

Beginning about 1966 the U. S. Office of Education began to 
develop a large data base of materials relevant to the full range of 
educational endeavors. ^ Early in the planning two decisions were made. 
One was to provide abstracts to permit a rapid search through the many 
documents; the second was to vhave the abstracts put on computer tape 
for rapid retrieval. At that time, no workable programs for abstract 
searches Dy computer existed. Indeed, many difficulties were experienced 
in getting operational, computer-based retrieval systems. However, in 
1967, the University of Oklahoma, using its ^General- Information Processing 
System (GIPSY), had .all existing ERIC abstracts available for computer 
based searches. The functioning of this 'system has been described else- 
where in the literature, (Kowitz/ 1970; Kowitz, et al; 1971; Kowitz', et al 
1973). ^ 4 , , 
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Many formulas have been developed to implement the study oC 
readability* Host began with the idea that if the readability level 
of material can be matched reasonably well with the skills of the 
reader he will profit more from them. The idea has been used both . 
in the teaching of reading and in the development of materials for 
teaching in other fields. Some f\ave bbjccted to the use of 
readability formulas to write materials because they produce poor 
.literature (Bomuth, 1968). Others have suggested that: while the 
formulas should not be used directly in writing, knowledge of the 
elements of the formula can be used in developing % guidelines which 
will produce more readablq materials (Klare, 1963). 

ERIC - ^ , . 

The ERIC system presented "a second interesting phase of the 
problem. The abstracts were written by many people ranging in 
occupation from housewives to graduate students. Clearinghouses 
were established in specific areas of ^education. Each of them has the 
assignment of collating documents within its topic and writing abstracts 
of t them. The central office of ERIC provided guidelines for writing 
abstracts to be used by all clearinghouses. 



Documents, Abstracts and Readability 

The present study identified several clearinghouses on 
a random basis within certain constraints . Only those clearinghouses 
which had a long history* were to.be used. Thus, it would be possible 

to gauge the consistency of the readability of the abstracts. . * A list' 

{ ♦ • 

of all abstracts from the selected clearinghouses was assembled and 

«* • • 

sample abstracts were drawn. at random. Constraints also were applied- 



to the selection of abstract. No abstract would be. used if it 
was primarily a listing or bibliography, contained lens than one 
hundred words; or referred to a curriculum gu^de or other catalog 
materials. Subsequently , the source documents, available * on 
microfiche, were sampled. The Flesch Reading Ease formula was then 
applied to the body of the abs tract and to the sample pages of the 
source document. 

<t ) 

Because the number of documents in ERIC-RIE is so large, 
a problem existed in sampling. The problem was approached through the 
concept of estimation of the power of the analysis of variance. In 
an earlier study, (Kowitz, et al, 1973) „the range of readability 
of abstracts fi'om a clearinghouse was found to be approximately six 
grade levels. Therefore, it was concluded that a difference of 
1.50 standard deviations would indicate significant differences at the 
5% level of confidence. Given this information, it was determined 
^hat equal sized samples of 12 abstracts drawn at random from each 
clearinghouse would provide ah adequate base for statistical inference. 
Similarly, when considering the list of clearinghouses with the longest 
his tories ,' it was determined that four clearinghouses would provide, 
an adequate base for this first investigation. The clearinghouses 
identified were: 

1. Adult Education . < . 

2. Educational Management } , . 
* 3. Educatio.nal Media* and Technology * 

„ 4. Rural Education and Small Schools 



The reference numbers of the abstracts listed by clearinghouses 

V 

are available on request. The Flesch Readability Index was applied to 

" * - . } V ; 

both source document samples and to their abstract;?. ^ 



The following hypotheses *;ere tested : 

1. Abstracts should have a lower reading level* than the- 
original documents. * r 

2. The" reading level of ipaterial processed by a clearinghouse 
from one area of education, is different from that processed from other 
areas. . 

3. The clearinghouses that produced abstracts v/ith the lower 
reading levels processed documents of the lowest reading levels. 

' 4. Different clearinghouses produced abstracts with different 
readability levels. , 

5. There is a difference among the reading levels of the 
documents abstracted by different clearinghouses. 

6. There 'is a difference in t>he variability of the readability 
J of abstracts produced by different^ clearinghouses. 

Results * ' - 

The means and standard deviations for source documents and 

abstracts are presented in Tafile 1. -The result? of' th<* correlated measures 

analysis of variance are in Table 2 and the post hoc pair-wise comparison 

.of means in Table 3. (dote! Ta^<?s, ^cAu^A; ;o T>3p*r-^ 

f ' 

Because of the conflicts described^ earlier between theories of 

• i . y 

readability ^and information, a non-directional test wa,s used. Results 
• of testing hypotheses indicates that the abstracts had 4 more difficult 
level of * readability"* than did Tsiua* samples from, the original documents. 
All differences between the readability of abstracts and source- documents , 
hypothesis l,^were significant except for the Clearinghouse for ..Adult 
Education. . The test of hypothesis 2, the reacting levels of 
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materials produced in the different areas, f£ii.led to reveal a significant 

• . f 

difference* , Hypo thesis ' 3, which suggested that 1 the -ahs tracts with the 
loves t 'reading levels would rfcsult" from documents' with the lowest • 
reading levels was"' not supported by the analysis, There was a / 
significant interaction between clearinghouses and the production/ of 
'abstracts. This is illustrated in Figure 1. * • 

4 

The readability of abstracts produced -by different clearinghouses 
hypothesis 4, resulted in one statistically significant difference, 
.between the abstracts from Educational Management and Adult Education. 

The source documents" abstracted by different clearinghouses, 
hypothesis 5, failed to. shox* significant differences in their * 
, reading "levels • ! 

The last hypothesis was tested using the F-inaximum test for 
- homogeneity of variances among the readability scores of abstracts and 

• source documents from the different clearinghouses. "The resuits were 4 

/ 

no t statistically significant. . 

C onclusion > ■ 

The use of " guidelines for preparing abstracts appears to 

be an effective 'tool. However, the general assumption that abstracts 

* \ 
provide a more readable as well as a briefer statement of the original 

document, was not supported. In general, however, the grade level " 

Equivalents indicated that both the abstracts and the source documents* 

were in the desirable range of readability. It wbu^d seem, therefore,', 

that the ERIORIE system shoulfi b$ a valuable source for educators 1 

in locating documents in which they are interested. 
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